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ABSTRACT 

In this paper, we present a derivation of the rest-frame 1400A luminosity function (LF) at redshift 
six from a new application of the maximum likelihood method by exploring the five deepest HST/AGS 
fields, i.e., the HUDF, two UDF05 fields, and two GOODS fields. We work on the latest improved 
data products, which makes our results more robust than those of previous studies. We use un-binned 
data and thereby make optimal use of the information contained in the dataset. We focus on the 
analysis to a magnitude limit where the completeness is larger than 50% to avoid possibly large errors 
in the faint end slope that are difficult to quantify. We also take into account scattering in and out of 
the dropout sample due to photometric errors by defining for each object a probability that it belongs 
to the dropout sample. We find the best fit Schechter parameters to the z ~ 6 LF are: a = 1.87±0.14, 
M* = -20.25 ± 0.23, and 0* = l^Tt";^ x 10 ~ 3 Mpc" 3 . Such a steep slope suggests that galaxies, 
especially the faint ones, are possibly the main sources of ionizing photons in the universe at redshift 
six. We also combine results from all studies at z ~ 6 to reach an agreement in 95% confidence level 
that —20.45 < M* < —20.05 and —1.90 < a < —1.55. The luminosity density has been found not to 
evolve significantly between z ~ 6 and z ~ 5, but considerable evolution is detected from z ~ 6 to 
z ~ 3. 

Subject headings: galaxies: evolution — galaxies: formation — galaxies: high-redshift — galaxies: 
luminosity function — methods: data analysis 



1. INTRODUCTION 

Deep imaging surveys, such as the Great Observa- 
tories Origins Deep Survey (GOODS, iGiavalisco et al.l 
2001 and the Hu bble Ultra Deep Field (HUDF, 
Beckwith et al.ll2006f) , have been extensively analyzed to 
study galaxy properties out to the reionization epoch. 
The rest-frame ultraviolet (UV) galaxy luminosity func- 
tion (LF) is measured for samples of Lyman break galax- 
ies (LBGs) and used to detect cosmic evolution. The 
consensus that has developed is that a considerable in- 
crease in the space-density of galaxies at the bright end 
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of th e LF occurs from redshift z ~ 6 (IBunker et alj 
200i lYan fc Windhorst I [200l IBeckwith et al.1 120061: 



Bouwens et alj2006fFl tc >z ~ 3 (e.g.. lSteidel et al.ll999fl 



However, there are still some discrepancies in the inter- 
pretation of this evolution, in terms of density, slope, lu- 
minosity, or a combination of these. iBunker et al.l ()2004[ ) 
undertake a photometric analysis of the HUDF 1775- 
dropouts and propose that the density i ncreases six-fold 
from z ~ '6 to z ~ 3, in agreement with IBeckwith et al.l 
(2006). lYan fc Windhorst I (|2004D push the detection 
limit deeper to magnitude 30, finding a steeper faint 
slope at z ~ 6 compared to z ~ 3 by 0.2-0.3. Further- 
more, iBouwens et al.1 (|2006l ) estimate corrections to the 
measured quantities to account for various observational 
effects and conclude that the intrinsic luminosity is ~0.8 
mag fainter at z ~ 6. Their conclusions r emain qualita- 
tively unchanged after iReddv fc Steidel I ([20091 ) recently 
revisit the LF parameters at z ~ 3. On the othe r hand , 
ground- based observations, e.g., iMcLure et al.l {2009), 
find an even stronger luminosity evolution. 

Different measurements of the luminosity density (LD) 
or star form ation rate (SFR) also give somewhat diffe rent 
results (e.g. . IBunker et aLll2004t IBouwens et al.ll2006l ). It 
is important to establish whether these observed differ- 
ences are due to intrinsic differences in the evolution of 
different galaxy populations or due to issues with the 
derivation of the LF. 

S pectroscopic con firmat ions of z ~ 6 g alaxies , 
e.g.JMalhotra et all (120 01 .IDow-Hygelund et al.1 (f2007h. 
IHathi et al.l (|2008l) and IVanzella et al.l (|2009D . have al- 
ready proven the effectiveness and robustness of the 

12 The results of these groups are summarized in Table [4] 
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dropout technique in selecting LBGs. However, the faint 
LBGs, which are essential to determining the faint-end 
slope of the LF, have not been spectroscopically con- 
firmed because they require impractically long exposure 
time on large telescopes. 

Therefore, to improve upon the previous studies of the 
z ~ 6 LF and to establish its form, a number of difficult 
issues should be considered, (a) Optimal use of the data: 
a single field provides us with only a handful of candi- 
dates so that some magnitude intervals contain only very 
few objects. Thus, it is very important to keep all the 
information. In order to do so, we use un-binned data, 
(b) Completeness of the catalogs: the correction to the 
number of objects observed at faint magnitudes is sig- 
nificant due to the detection incompleteness. We adopt 
a more moderate magnitude limit than other groups in 
order to avoid possible uncertainties brought by large 
corrections, (c) Photometric errors and biases: a strict 
color cut used for 2775-dropout selection may lose real 
LBGs and is affected by contaminants. For each galaxy 
within or outside the selection window, we explicitly con- 
sider its probability of being an actual LBG by assuming 
a Gaussian distribution for the photomet ric error 



On the basis of the HUDF images (Beckwith ct al 



2006, hereafter paper I), the UDF05 images (Oes ch et al 



20071 hereafter paper II), and the H UDF09 images 
(|Oesch et afllMtq iBouwens et alj|2010al) . we are now m 
the position to study properties of LBGs from z ~ to 
beyond z ~ 8 utilizing Hubble Space Telescope's (HST) 
unparalleled deep optical and infrared (IR) view. In this 
paper, we plan to further develop techniques to derive the 
LF at z ~ 6 using the procedures used for z ~ 5 galaxies 
in paper II. In particular, we apply the maximum like- 
lihood (ML) method, which is independent of clustering 
in our sample, to derive the LF and examine whether 
star forming galaxies, especially the faint ones, are re- 
sponsible for re-ionizing or keeping the universe ionized 
at z 6. 

We adopt ACDM cosmology: Cl M = 0.3, fl A = 0.7, 
and Ho — 70 km s _1 Mpc -1 . Magnitudes are in the AB 
system. 

2. DATA 

We work on five HST/ ACS deep fields in four broad 
bands: F435W (£435), F606W (Vfcoe), F775W (i 775 ), 
and F850LP (zsso)- We use the most recent and up- 
dated version of the data, namely: GOODS South 
(G OODS-S) fc GO ODS North (GOODS-N) v2.0 data 
bv iGiavalisco et all (|2008[ ). the HUDF data from paper 
I, HUDF NICP12 from paper II, and HUDF NICP34 
processed in this work. PyRAF tas ks Multidrizzle and 
Tweakshifts (jKoekemoer et al. 2006) help precisely al ign 
the images, and SExtractor fB ertin fc Arnoutslll996| ) is 
run in double-image mode with z^q as the detection 
band to generate the catalogs. Our survey covers ~ 350 
arcmin to a magnitude limit of zg§o ~ 29, identifying ~ 
1100 LBG candidates at z ~ 6 , with an average number 
of 350 per realization, as shown in Tabic [TJ 

We have not made use of the WFC3/IR data that are 
becoming available on these fields for two main reasons: 
(a) The IR data are not available over the full fields, 
especially only a small portion of the GOODS has been 
covered. This would force us to reduce the sample size 
greatly, (b) We think an important component of this 



work is a comparison with other published results which 
are based on the simple one color selection rather than 
a full two-color selection. We do make a quick check of 
the IR information in the HUDF in Section 13.11 and will 
leave a full investigation for future work. 

We also do not use ground based data for two main 
reasons: (a) The two GOODS fields are already large 
enough to provide good constraints on galaxies brighter 
than the knee of the Schechter function, (b) We prefer 
to work with a homogenous data set in terms of filters 
and detector QE curves. 

3. LUMINOSITY FUNCTION OF LBGS AT z ~ 6 

The completeness function C(m) (m is the appar- 
ent/detected magnitude) and the selection function 
S(m, z) (z is the redshift) are measured by performing 
recovery simulations in the same way as in paper II, i.e., 
by inserting artificial galaxies into our science images 
and rerunning SExtractor with the same setup as for 
the original catalog generation. W e use a j3— distribution 
-2.2 ± 0.4 (jStanwav et all 120051 ) and a size distribution 
follow ing a scaling of (1 + z)^ 1 as in iFerguson et al.l 
(p00l . For each redshift bin Sz = 0.1, we thus com- 
pute the color a galaxy would have with the randomly 
chosen j3— value and insert it in the images. The input 
magnitudes are following a flat distribution from 24—29, 
but the selection function is given at observed magni- 
tudes, simply by computing the fraction of galaxies that 
we insert with the measured output magnitude which is 
selected by the Z775-dropout criteria. C(m)dm is defined 
as the probability that a galaxy of m in the images is 
selected in the catalog, which depends strongly on SEx- 
tractor parameters such as DEBLEND. Thus, it is im- 
portant that the recovery simulations are done using the 
same SExtractor parameters used to derive the catalog. 
S(m, z)dmdz represents the probability that a LBG at 
a given redshift z and at a given observed magnitude m 
satisfies the selection criteria. Naturally, the product of 
these two functions C(m)S(m, z)dmdz is the probability 
that a galaxy at redshift z is detected with magnitude m 
AND selected as a LBG. 

The UV LF can be expressed in Schechter form as, 

0(M) = (0.41nl0)<M0°- 4(1+Q)(M -- M) exp[-10°- 4(M *- M) ] 

(1) 

with the absolute magnitude M — m — D M (z) — K cor (z) , 
where DM(z) is the distance modulus and K cor (z) is the 
K-correction from observed zsso to rest-frame 1400 A. 

Binned data were initially utilized by many groups to 
derive the shape of the LF. The observed number of 
LBGs within the apparent magnitude bin mi < m < m u 
is predicted as 

Ni = / dz d ^L [z) 
az 



dmC(m)S(m, z)tfi(M(m, z); 0*, M*, a) 

(2) 



where dVo j dz is the comoving volume element of the sur- 
vey. Binning may lose information, and lead to biased re- 
sults dependent on the bin size. At the same time, having 
very few luminous candidates in current high-z surveys, 
there is uncertainty about the numbers in the bright bins 
since the candidates could jump into adjacent bins due 
to pho tometric errors. Simulations bv lTrenti fc Stiavelli I 
( 2008) show that binning is likely to affect the confidence 
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regions for the best-fitting parameters. 

To overcome these drawbacks, in this section we 
present an improved approach based on the ML m ethod 
(jFisher lll92l iSandage. Tammann. k Yahil lfl979l STY) 
to make optimal use of e very possible LBG i n the fields. 
As also pointed out by iTrenti k Stiavclli (2008]), the 
STY ML estimator relies essentially on un-binned data. 
We determine the shape of the LF by exploring every sin- 
gle detected dropout. First, we find the probability for 
each galaxy that it could be selected as a LBG, consider- 
ing the photometric uncertainty of the catalogs (Section 
13. 2p . Second, we choose galaxies randomly by the above 
probability and run our ML process (Section l3.3[) . Third, 
we repeat the above step enough times to achieve con- 
vergence. 

3.1. Selection Criteria 

We adopt the Z775-dropout selection criteria from paper 
I, i.e., 

«775 - ZS50 > 1-3, (3) 

S/N(z S50 ) > 5, (4) 
S/N(V 60e ) < 2orU 606 - z 850 > 2.8. (5) 

The dominant criterion, i.e., the SExtractor MAGJSO 
colo r ^77 5 — Z850> 1-3, will be further discussed in Sec- 
tion [3?2] The signal-to-noise ratio S/N(zs5o) > 5 is de- 
manded for each candidate to largely avoid interlopers 
(later this subsection) or slope steepening (Appendix), 
and to be consistent in comparing with z ~ 3 results 
from iSteidel et all (|1999f ) and with z ~ 5 results in pa- 
per II. The photometric errors also take into account 
the correlated errors present in the images as discussed 
in paper II. In addition, we require for CLASS_STAR 
< 0.75 if the MAG.AUTO magnitude z S5Q < 28.0 for 
the HUDF, < 27.5 for the UDF05, and < 26.5 for 
the GOODS in order to remove stellar con tamination 
at the bright end (e.g.. iBouwens et al]|2006l and paper 
II). Only galaxies with C(m) > 0.5 have been included 
to avoid large uncertainty corrections (Table [2]). The 
selection has been proven to be very efficient and effec- 
tive. All the spectroscopically confirmed 1775 — Z850> 1.3 
z ~ 6 LB Gs through the HUDF/GOODS follow-up sur- 
veys fe.g. JMalhotra et al.ll2005HVanzella et al.ll2009H sat- 
isfy our criteria, with only one exception, and no Galactic 
star could pass the CLASS_STAR test. 

We have estimated the possible fraction of interlop- 
ers by applying our selection criteria of equations (3)-(5) 
to a library of ^3000 synthetic SEDs bui lt on Bruzual- 
Charlot models dBruzual k Charlot"ll2003l) , adopting the 
LF derived by ISteidel et al.l (|1999f) at z ~ 3 and no 
evolution. The models includ e the effects of intergalac- 
tic absorption (|Madau 1 119951 ). and span a wide range 
of metallicities (0.04-2.5 Zq), dust reddening (no ex- 
tinction, or eight values logarithmically spaced between 
Ay = 0.05 and 6.4), emission lines (no lines or lines 
computed from first principles from UV SED for Hydro- 
gen and fit to Cloudy models for metal lines), and dif- 
ferent star formation histories (burst, constant at fixed 
metallicity, constant at evolving metallicity without in- 
fall or with infall, two component models with an old 
component and a young one which may include emission 
lines). We consider 18 ages logarithmically spaced be- 
tween 1 Myrs and 18 Gyrs. And no model older than 



the universe is included. We can see from the resulting 
redshift distribution (Fig. [IJ that there is a lower red- 
shift population z ~ 1,2 of galaxies that may be selected 
as LBGs at z ~ 6 due to the aliasing between the Ly- 
man break and the 4000A break (See e.g., iDahlen et al.l 
120101 for more discussions). In Fig. [2] we have iden- 
tified our 1775 — Z850> 1-3 candidates detected by the 
WFC3 F105W (Y105) band in the HUDF to verify that 
our sample does not have many interlopers. 

3.2. f-factor 

Photometric scatter introduces large uncertainties in 
numbers and magnitudes of the LBG candidates, and 
therefore, in determined properties of the LF. If a strict 
color cut such as 1775 — Z850> 1.3 was applied, the impact 
of photometric errors would not be fully explored, and 
many real LBGs with a little bluer measured color may 
be missed due to photometric errors. A relaxed cut, e.g., 
*775 — z 850> 0.9, on the other h and, suffers from larger 
contaminations. For example, Malhot ra et al.l (2005) 
found five objects at intermediate redshifts and four in- 
trinsic z ~ 6 galaxies within 0.9 O775 — ^850< 1-3, which 
means the contamination rate in the relaxed color win- 
dow may be as high as 5/(5 + 4) = 56%. 

To account for this effect, we calculate the probability 
that each object is an LBG, which decides how often it 
could contribute to the later ML process. If p(m)dm 
is the probability that a galaxy is of magnitude m in 
the catalog, then the /-factor of 1775 — z 850 > 1.3 LBG 
candidates is defined as: 



/ = / dz 8 50dz775 P(Z850M*775) 



(6) 



where the integration of 1775 is taken over 1775— zs50> 1-3. 
The real magnitude m is assumed to be a Gaussian dis- 
tribution around its cataloged magnitude m c (See Ap- 
pendix for details). In practice, one could find the values 
of /-factor with a Monte Carlo method by simply gener- 
ating Gaussian distributed magnitudes repeatedly to see 
how often the 1775 — zs50> 1-3 color would be satisfied. 
A 2-er magnitude limit is adopted if there is no detection 
in the i775-band. 

It is easy to see that / > 0.5 when the cataloged 
*775 — z 850> 1-3 while / < 0.5 when the cataloged 
*775 — z 850< 1-3, and / = 0.01 corresponds to the cat- 
aloged 1775 — zg5o ~ 0.9 when the zsso and 1775 errors 
are both 0.2. All / > 0.01 galaxies are used in the sub- 
sequent ML analysis, i.e., 1% chance of being included 
in one realization. Table [1] shows that essentially about 
25% - 50% candidates in each field will participate in one 
realization, which brings our sample in agreement with 
ot her groups within the m agnitude window in study, such 
as IBouwens eTafl pOOTh . (See Fig. [3] and Tabled) 

3.3. V-Matrix 

Due to the unique long tail of the ACS Zsso-filter, the 
K-correction can be as large as 2.2 mag at z — 5.7 and 
goes down to 0.3 mag at z = 7.0. Thus, with distance 
modulus varying by 0.5 mag there could be a 2.4-mag 
scatter in UV rest frame absolute magnitudes in real- 
izations at 5.7 < z < 7 for any given observed zgso- 
magnitude. In other words, the relation between M and 
m is very uncertain. Therefore, applicable at where M 
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is relatively insensitive to redshift or the redshift span 
is relatively small, the effective volume Veff technique 
does not fit in our case. This forces us to seek a new 
formalism. 
We define the apparent LF as 

$( m ) = f dzS(m,z)^(zWM;m,z) (7) 

Veff J dz 

and it does not need to be of Schechter form. The V- 
matrix is therefore, 

V{m,z) = C{m)S(m,z)^-(z) (8) 

and V e ff (m) = J dzV(m, z). We maximize the likeli- 
hood function InL = J^. lnp(mi) where 

p(m ! ) = $(m 1 )/ J dm§(m) (9) 

= J dzV(rrii,z)(f>(Mi)/ J J dmdzV(m,z)(f>(M) 

The integrations are always taken over the region of in- 
terest, for example for the HUDF, 5.7 < z < 7.0 and 
24.0 < m < 28.5. (The bright limit is introduced for 
calculations only when there is no candidate detected 
beyond this magnitude, and an even brighter limit will 
not affect the results since the LF is greatly suppressed 
at this end.) C(m) has been included in the calculation 
of V(m, z) so that there is no additional completeness 
correction factor in p(rrii). F 3 ! 

When combining different fields, e.g., the GOODS and 
the HUDF, no a dditional rescaling factor is needed in 
the ML method (jTrenti fe Stiavelli I [2008h . The inputs 
to the ML process are the V-matrix and the magnitudes 
m of selected candidates. In each realization, candidates 
are selected from the pool in a probability as to their 
/-factor. The outputs are M* and a in as many as possi- 
ble realizations, when the averages and errors have been 
convergent. The uncertainty of m considered in the ML 
process only yields minor errors when several hundreds 
of galaxies are surveyed (Appendix). <j>* is determined 
by x 2 n t to the observed LBG densities with respect to 
the l-<7 2-parameter contour of M* and a. 

The LF parameters we derive for z ~ 6 are: a — 
-1.87 ±0.14, M* = -20.25 ±0.23, and </»«, = 1.77tg;|g x 
10 -3 Mpc -3 , as illustrated in Fig. H) We notice our faint 
end slope a is slightly steeper than that from some other 
studies. This could partly be caused by a steeper slope 
at z ~ 7 (e.g- lOesch et alJl2010b fTrenti et aLll2010D since 
we include up to z = 7 LBGs in our estimate of the z ~ 6 
LF. 

3.4. Evolution of <f>* 

Since we are investigating a relatively large redshift 
range 5.7 < z < 7.0 and finding indication of LF evo- 
lution, it is a good sanity check for us to explicitly con- 
sider the effect of evolving LF parameters. Assuming 
-M* and a are uniform in this redshift range, we assign 
a linear evolution <j>*(z) = </>*(6.3)[l — |(z — 6.3)] and 

13 We note that Marshall (1985) adopted a similar approach to 
ours and he did not have to take the integration of redshift as shown 
above since the redshifts of their objects were already known. 



repeat the analysis described in Section 13.11 - 13.31 We 
find that a = -1.92 ± 0.13, M* = -20.22 ± 0.21. The 
closeness to our derived parameters for no evolution, i.e., 
a = -1.87±0.14andM* = -20.25±0.23, shows that our 
results are robust with respect to an evolution of the LF 
normalization within the redshift range of Z775-dropouts 

3.5. Evolution of 

Similar considerations to those in the previous sub- 
section lead us to explore a variation of M* within the 
«775-dropout redshift window. We do so by ass i gning 
M*(z) =M«(5.9) + 0.36(z - 5.9)] (jBouwens et all [20071 
IQesch et al.H2010D while keeping uniform values of a and 
4>*. We find a = —1.91 ± 0.08, which is also within one 
sigma of our non-evolving derivation. 

4. COMPARISON TO OTHER RESULTS 

We have verified the internal consistency and robust- 
ness of our results and we are now ready to compare them 
to other studies. 

4.1. Most Probable z ~ 6 LF 

To deal with the weig hted av e rage o f results from dif- 
ferent groups, we follow iPressl (|1996l ). The probability 
of getting observed variable(s) Hq from data or measure- 
ments D is 

P(Ho\D)ocl[(P Gt + PB l ) (10) 

i 

Here P Gi ~ j- exp[ ~ ( ^~;f o) ] and P Bi ~ 

^ exp[ ~*-" H ^g/ f °' 1 ] are the probability distributions 
of "good" and "bad" measurements, respectively, where 
i denotes different measurements, and S should be as- 
signed to be large enough to ensure that measurements 
do not conflict with each other. When extending this 
method to two-dimensional analysis, we also c onsider 
the co rrelation between and a (Fig. 0J. iPress I 
(1996) puts almost no weight on those measurements 
without errors where Pqi = and Pbi is widely spread. 
Instead, we assu me a moderate e rror of 0.3 for those 
six gr ou ps, i.e., IBouwens et al.l (I2004D. IBunker et alJ 
(2004), iDickinson et all (12004 1). lYan fc Windhorst I 
(|2004f) . iMalhotra et all (|2005l K~and paper I. Combined 
with the other four measu re ments providin g errors , 
i.e.. IBouwens et all (|2006D . IBouwens et"all (|2007D . 
iMcLure et all (|2009l ). and this work, we find there is 
about a 95% chance that -20.45 < M* < -20.05 and 
— 1.90 < a < —1.55, assuming all the current studies are 
independent and correct. (See Tableland Fig. [5]) 

4.2. z ~ 5 LBGs LF revisited 

In order to further test the method used here, we de- 
rive the faint end slope of the z ~ 5 LBG LF using the 
same catalogs and the same selection criteria as those 
in paper II. To study the HUDF and NICP12 data that 
lack enough bright candidates to determine M*, we fix 
M* = -20.7 to find a = -1.72 ± 0.04, which is in agree- 
ment with the previous results (their Table 3). Thus, our 
method, designed to deal with the varying K-correction 
in zgso and to account for additional uncertainties, is 
equivalent to our previous method in the simpler Vqqq- 
dropout case. 
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4.3. z — 3 ~ 6 Luminosity Density 
The luminosity density (LD) at redshift z equals 
J L(j)(L)dL = L*(z)(f)*(z) J Xg x 1+a e~ x dx, where x = 

L/L*(z). We find there is considerable evolution between 
z <~ 6 and z ~ 3, but no statistically significant evolution 
between z ~ 6 and z ~ 5. More details are in Table [5] 
and Fig. [7]where a; = aL*{Z)/ L*{z) and a=0. 3,0. 2,0.04. 
At lower redshifts there are fewer recombinations in the 
diffuse medium and therefore the required flux density to 
keep the universe ionized increases with increasing red- 
shift. If the universe has finished reionizing at z ~ 6 , 
then it will be kept ionized at z ~ 5 since the required 
LD at z ~ 5 is less than that at z <~ 6 and the observed 
ones are close to each other. 

5. CONCLUSIONS 

In this paper, we have reported the results of a study 
of a large sample of faint LBGs in the redshift interval 
5.7 < z < 7.0. Working on the five deepest HST fields 
with their most updated data, we account for the effect 
of photometric errors by introducing the factor f as the 
probability of each galaxy to be an LBG. We employ 
un-binned data to keep all the information and to avoid 
bias, and we develop a modified ML process to reduce the 
effect of the uncertain relation between M and m. Our 
best-fitting Schechter function parameters of the rest- 
frame 1400A LF at redshift z ~ 6 are: a = -1.87 ±0.14, 



M* = -20.25 ± 0.23, and 6* = 1.7V 



x lO - 



-0.49 - ^ M P C ) 
which suggest evolution of M*, possible steepening of a, 

and no change of (f>* compared to their values at z <~ 

3. Such a steep slope suggests that galaxies, especially 

the faint ones, are possibly the main sour ces of ionizing 

photo ns in the universe at redshift six ( Stiavelli et al.l 

2004) . Combining ten previous studies at z ~ 6 with the 



extended Press method, we find that the most probable 
LF favors -20.45 < M* < -20.05 and -1.90 < a < 
— 1.55 at the 95% confidence level. The LD has been 
found not to evolve significantly between z ~ 6 and z ~ 
5, but considerable change is detected from z ~ 6 to 
z~ 3. 

If a remains constant fr om z ~ 6 to z ~ 3 as stated b y 
e.g. JBouwens et al.l (|2007f l and lReddv fc Steidel I (|2009]) . 
it will be difficult to tell the intrinsically evolving pa- 
rameter, M* or </>*, from faint LBGs only, while too few 
bright LBGs are found due to the limited area of cur- 
rent deep surveys. Ground-based surveys such as the 
Suba ru Deep Field (iShimasaku et al.ll2005l;lMcLure et al.l 
2009) arc extremely efficient in detecting bright LBGs in 
a large field of view and might clarify whether M* or 
0* alone is not responsible for the change of LF, while 
splitting the zsscrband into two separate bands may be 
useful to isolate the effe ct of a possible slope steepening 
(|Shimasaku et al.l [2005). We look forward to including 
IR data from WFC3 on board HST to improve the selec- 
tion of z ~ 6 LBG candidates, and the bright end of the 
LF will be better determined when the data from CAN- 
DELS / ERS (e.g.. iBouwens et al.l l20l"0bh and the BoRG 
survey (jTrenti et al.ll2011f ) are becoming available. 
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APPENDIX 

MORE ABOUT PHOTOMETRIC SCATTER AND FLUX BOOSTING 

We assume the photometric scatter is in a Gaussian distribution, thus the probability of a galaxy arriving on the 
detector as magnitude to but cataloged in ml equals 



G(m, to', a) 



1 , (m-m 1 ) 2 ^ 

exp[- 



2a 2 



and the measured LF will be 



%/27R7 2 

(j>'(m)= I 4>(m')G(m,m' , a)dm' 



(Al) 



(A2) 



where 4> is the actual LF, i.e., Equation (7) in Section [ 

When the photometric error a is very small, G takes the limit of the Dirac function and it is always true <fr' = <f>. 
When the surveys are pushed close to the detection limit, er is not negligible and also far from uniform in the magnitude 
window. To satisfy S/N = 10 at to = to, and S/N = 5 at to = to* + 2.5, a guess would be 



ct(to) 



2.5 



1 



ml0 2(m* - to) + 10 



(A3) 



Simulations show that the effect of flux boosting from fainter magnitudes outside our selection window is negligible. 
But as shown in Table |H1 if ct(to) increases much faster with to, or if lower S/N candidates are included, there will 
be considerable steepening at the faint end due to the photometric scattering. We simulate 4000 objects according 
to the given LF parameters, i.e., to* is fixed and a — -1.7 in [to*-3.5,to*+4.5]. Their magnitude errors are assumed 
to be in the form of io°- 3 ( m_m *) which comes from the real data of the HUDF. For each realization, the change of 
magnitudes brought by their errors will also change their detected S/N. We choose those with the S/N> 5 and lying 
within [to*-2.5,to*+2.5] to determine the slope. This process repeats for different combinations of S/N> 5, 7, 9 and 
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Fig. 1. — Predicted redshift distribution for i775-dropouts as derived assuming synthetic SEDs and a non-evolving LF in the redshift 
window 5.7 < z < 7. The total interloper fraction is estimated to be 24% and is primarily contributed by lower redshift galaxies selected 
as LBGs due to the aliasing between the Lyman br eak and the 4000A break. The model is pessimistic and at the relatively bright end 
(z850< 27.5) comparison with Malhotra ct al. (2005) shows a factor of two fewer interlopers than predicted by the model. 



a = -1.5, -1.7, -1.9. We can see from Table[6]that if the S/N is kept 
flux boosting is less than 0.1. 



> 5, the steepening of the faint end slope by the 
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Fig. 2. — Color-color diagram of the HUDF 4775 — zgso> 1.3 candidates. Z850 image is rescaled to match Y105 to get the Z850-Y105 color. 
The dash lines give a possible i775-dropout selection criterion, namely 1775 — zg5o> 1.3 and zsso-Yios < 1 + 0.09(4775 — 2350-!. 3). 



TABLE 1 
Dropouts in Our Sample 





HUDF 


GOODS-S 


GOODS-N 


NICP12 


NICP34 


N to t a 


115 


373 


502 


120 


54 




58.1±2.3 


103.1±6.5 


116.2±7.0 


33.9±3.0 


23.5±5.7 



a Total number of galaxies in our candidates pool. 
b Average number of galaxies in one realization. 



TABLE 2 
Completeness of the Fields 



2850 a 


HUDF 


NICP12 


NICP34 


GOODS 


24.25 


0.95 


0.95 


0.96 


0.96 


24.75 


0.94 


0.94 


0.95 


0.96 


25.25 


0.93 


0.94 


0.94 


0.95 


25.75 


0.92 


0.93 


0.93 


0.94 


26.25 


0.91 


0.92 


0.92 


0.86 


26.75 


0.89 


0.91 


0.87 


0.61 


27.25 


0.87 


0.86 


0.70 


0.30 


27.75 


0.79 


0.72 


0.43 


0.10 


28.25 b 


0.60 


0.47 


0.19 




28.75 


0.37 


0.23 


0.07 





a Central bin magnitude. 

b Only data with completeness above half are con- 
sidered to avoid large uncertainty corrections. 
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Fig. 3. — Color-magnitude diagram of the HUDF candidate pool. Candidates are indicated as filled circles whose radius is proportional 
to the /-factor, and asterisks are those objects with /-factor less than 0.2. The diamonds are 1775-dropouts selected in one realization for 
use in later ML process, and the line segments connect the cataloged and realized positions in the diagram. 



TABLE 3 
Binned numbers of ^s-dropouts in 
the HUDF a 



*850 (1) 


N c ( 2 ) 


N/3) 




24.75 





0.00 


0.01±0.12 


25.25 


2 


1.95 


1.94±0.25 


25.75 


1 


0.83 


0.84±0.39 


26.25 


1 


1.00 


1.26±0.50 


26.75 


8 


8.42 


8.11±1.47 


27.25 


16 


15.52 


16.54±1.98 


27.75 


21 


19.22 


18.07±2.34 


28.25 


11 


11.13 


11.30±2.19 



a for illustration only, not for later calcula- 
tions. 

M Central bin magnitude. 

( 2 ) Number of 4775 — Z850> 1.3 1775- 
dropouts from the catalog without correc- 
tions. 

( 3 ) Number of J775-dropouts weighted with 
their /-factor. 

( 4 ) Number of 1775-dropouts in simulations 
considering /-factor. 
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Fig. 4. — Likelihood contour for the best fit Schechter parameters of the z ~ 6 LF. The contours, inner to outer, stand for 1-paramet 
1-ct, 2-parameter 1-cr, and 1-parameter 2-a likelihood contours averaged over realizations for use in the ML process. 



TABLE 4 

Studies of the z ~ 6 Luminosity Function 



References 


Fields 3 - 


N b 


a 


M* 


Bouwens et al. (20041 


UDF PFs (28.1) 


30 


-1.15 


-20.26 


Bunker et al~7200TT 


HUDF (28.5) 


54 


sS-1.60 


-20.87 


Dickinson et al. (20041 


GOODS (26.0) 


5 


-1.60 (fixed) 


-19.87 


Yan fc Windhorst"T2004l 


HUDF (30.0) 


108 


(-1.90,-1.80) c 


-21.03 


Malhotra et al. ( 20051 


HUDF (27.5) 


23 d 


-1.80 (fixed) 


-20.83 


paper I 


HUDF (29.0) 


54 


-1.60 (fixed) 


-20.5 


Bouwens et al. (2006) 


HUDF (29.2) 


506 


-1.73±0.21 


-20.25±0.20 


Bouwens et al. (20071 


HUDF (29.3) ... f 


627 


-1.74±0.16 


-20.24±0.19 


McLure et al. (2009) 


UDS (26.0) 


1578 


-1.71±0.11 


-20.04±0.12 


this work 


HUDF (28.5) ... h 


1164 


-1.87±0.14 


-20.25±0.23 



a The fields and zgso-band detection limit studied by the reference. 

b The number of candidates. 

c -1.9 < a < -1.8. 

d all spectroscopically confirmed. 

e HUDF (29.2)+HUDF-Ps (28.5)+GOODS (27.5). 

f HUDF (29.3)+HUDF05 (28.9 )+HUDF-Ps (28.6)+G OODS (27.6). 

s plus binned data points from Bouwens et al. (2007). 

h HUDF (28.5)+UDF05 (28.0)+GOODS (27.5) 
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Fig. 5. — Most probable parameter space at z ~ 6 based on ten studies. The inner contour includes 68% probability and the outer 95%, 
assuming all the stu dies are independent and corr ect. Two nearby squa res are from Bouwens et al. (2006, 2007), a third square is from 
McLurc et al. (2009) who combine their data with Bouwens et al. (2007), and the diamond is from this work. As illustrated in Fig. [3] M* 
and a are strongly correlated, so we do not plot their error bars, which can be found in Table [4] 



TABLE 5 

Evolution of the Luminosity Density 3 - 



Rcddy & Stcidel (2009) paper II this work 
(z ~ 3) (z ~ 5) (z ~ 6 ) 



AT, 


-20.97±0.14 


-20.78±0.21 


-20.25±0.23 


a 


-1.73±0.13 


-1.54±0.10 


-1.87±0.14 


L» c 
LD0.3 d 
LD0.2 
LD0.04 


1.71±0.53 
1 06+ 015 

1 - UD -0.13 

1 49+0.40 

1 89+ - 44 
o 97 +0.45 
°- z '-0.38 


0.9«; 3 3 

57+ - 14 
U -°'-0.12 

71+0- 15 
"■ ,1 -0.14 
, i 9 +0.15 
1 ' 1Z -0.14 


-, 77 +0.62 
x - ' ' -0.49 

0.55±i? 

i.7oi:» 



a See Fig. [7] for the graph. 
b in units of 10 -3 Mpc -3 . 
c in units of 10 29 erg s — 1 Hz -1 . 

d in units of 10 26 erg s" 1 Hz" 1 Mpc~ 3 . LD0.3 means that the LD 
is integrated from 0.3L*(z = 3)/I/*(z). 



TABLE 6 
The Steepening of a by the flux 
boosting for cr(m) oc io°- 3 ( m -™*) 





a = -1.5 


a = -1.7 


a = -1.9 


S/N > 3 


0.14 


0.18 


0.26 


S/N > 5 


0.03 


0.04 


0.08 


S/N > 7 


0.01 


0.02 


0.03 




Fig. 6. — Luminosity function from z ~ 3 to z ~ 6 
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Fig. 7. — Lu minosity density fr o m z ~ 3 to z ~ 6 integrated to 0.3 (diamonds), 0.2 (squares), 0.04 (circles) of L»(z = 3). 2^3 data 
calculated from Rcddy & Stcidcl (2009), z ~ 5 data calculated from paper II, and z ~ 6 data calculated from this work. Sec Table [5] for 
the numbers. 



